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Abstract. Stochastic finite-state generators are compressed descriptions of infinite 
time series. Alternatively, compressed descriptions are given by quantum finite- 
state generators [K. Wiesner and J. P. Crutchfield, Physica D 237, 1173 (2008)]. 
These are based on repeated von Neumann measurements on a quantum dynamical 
system. Here we generalise the quantum finite-state generators by replacing the von 
Neumann projections by stochastic quantum operations. In this way we assure that 
any time series with a stochastic compressed description has a compressed quantum 
description. Moreover, we establish a link between our stochastic generators and the 
sequential readout of many-body states with translationally-invariant matrix product 
state representations. As an example, we consider the non-adaptive read-out of ID 
cluster states. This is shown to be equivalent to a Hidden Quantum Model with two 
internal states, providing insight on the inherent complexity of the process. Finally, 
it is proven by example that the quantum description can have a higher degree of 
compression than the classical stochastic one. 
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1. Introduction 

The physical laws underlying quantum computation are a mixed blessing. On the 
one hand, a growing body of theoretical results suggests that a computational device 
whose components are directly governed by quantum physics may be considerably more 
powerful than its classical counterpart. As proof, several quantum algorithms have 
been constructed. The most celebrated ones are the factoring algorithm by Shor pQ, 
suggesting an exponential speed-up over classical algorithms, and the data-base search 
algorithm by Grover [2], proving a linear speed-up. They are quantum versions of 
algorithms that improve the efficiency of algorithms usually implemented on classical 
Turing machines. 

Contrary to this progress on the theoretical side, building a quantum computer 
in practice faces many hurdles. Implementations of quantum Turing machines must 
maintain high degrees of internal coherence and insulation to outer disturbances during 
operation. Thus, the current implementations remain with highly finite systems, much 
more of the character of finite-state machines than Turing machines [3]. In the yet 
to be completed hierarchy of quantum computational architectures quantum Turing 
machines are decidedly more powerful than finite-state machines. However, because of 
the "finiteness" of current implementations of quantum algorithms the lower part of this 
hierarchy and its potential computational power are of great interest. 

At this point, a look at information creation in dynamical systems turns out 
to be useful. Recently, one of the authors introduced a synthesis of quantum 
dynamics, information creation, and computing [U [5]. This lead to methods useful 
for analysing how quantum processes store and manipulate information. A quantum 
process was defined as a probability distribution over measurement outcomes of a 
repeatedly measured quantum system, formally represented as a process language. A 
measurement-based quantum- computation hierarchy was developed, providing insights 
into the information processing in quantum dynamical systems. This computational 
hierarchy allows for a classification of quantum dynamical systems in terms of the 
process languages they generate. Following this ansatz, we concentrate here on a 
characterisation of generators of process languages. The characterisation of recognisers 
is analogous (up to some exceptions [I]) but will not be addressed here. 

The quantum finite-state machines introduced by Wiesner and Crutchfield in 
2008 [I] generate bit sequences by applying a projective (von Neumann) measurement 
repeatedly to an otherwise dynamically evolving quantum system. In the following, 
we therefore refer to them as quantum von Neumann finite-state generators. However, 
there are regular languages which cannot be generated by a von Neumann finite-state 
machine [I]. An example is an alternating binary sequence with different probabilities 
for the two binary symbols [I]. Here we point out that it is possible to overcome 
this problem by replacing the projective measurements of von Neumann finite-state 
machines by stochastic quantum operations, i.e., generalized measurements described 
in the quantum operation formalism. We call the resulting stochastic processes Hidden 
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Quantum Markov Models (HQMM). 

Quantum operations are the most general transformations that a quantum state 
can undergo. This includes the possibility of the state being (partially) measured and 
the possibility of resetting or transforming the system conditional on the measurement 
outcome [6]. Contrary to projective measurements, the state of the system after a 
measurement may depend not only on the respective measurement outcome. In general, 
it may retain information about the state of the system prior to the operation and hence 
also information about previous measurement outcomes. Thus, the system acquires a 
memory which may be anything from classical to quantum. As a consequence, any 
process language which can be generated by a classical stochastic finite-state machine 
can now be generated by a quantum finite-state machine. Secondly, any iterative 
quantum process can now be represented as a quantum finite-state machine. Finally, 
we show by example that there are process languages which are generated with fewer 
resources using quantum finite-state machines compared to classical ones. 

There are six sections in this paper. Section [2] reviews stochastic processes, their 
formal representation as process languages, and stochastic finite-state machines as 
generators of such process languages. This is followed by a review of quantum processes 
and von Neumann finite-state generators in Section [31 Section H] introduces HQM Ms as 
computation-theoretic representations of general finite-dimensional quantum operations 
and presents an information-theoretic analysis of quantum systems under generalised 
measurements. Section [5] shows that the non-adaptive read-out of a ID cluster state 
generates the same process languages as a repeatedly measured dynamical open quantum 
two-level system. It therefore constitutes an example of a HQMM. Finally, we summarize 
our results and draw attention to some open questions in Section [71 

2. Stochastic Processes 

Consider the temporal evolution of some natural system. The evolution is monitored by 
a series of measurements — numbers sequentially registered. Considering the numbers 
to be discrete, each such measurement can be taken as a discrete random variable 
Xi. The probability distribution Pr(Xj^) over bi- infinite sequences X^ of these 
random variables is what we refer to as a stochastic process. Such a process is a 
complete description of a system's behaviour. An important question for understanding 
the structure of natural systems therefore is what kinds of stochastic processes there 
are. This question can be studied using stochastic finite-state generators which are a 
classification tool for stochastic processes. 

The distribution over sequences of random variables as a representation of a 
stochastic process is merely an enumeration of probabilities. It is not a very practical 
representation, let alone does it allow for any insights. Thus, it is desirable to find a 
more compact representation of a process than just the probability distribution over 
sequences. 

Among all possible stochastic processes, several models have proven successful in 
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order to model a wide range of practical situations. One such class of processes are the 
so-called Hidden Markov Models (HMM from now on). There are several possible ways 
to define a HMM. The most common among mathematicians is as a stochastic process 
S for which every symbol s n is generated conditionally from a Markovian process X, 
with probability Pr(s n \x n ). The Markov process X goes unobserved. This definition is 
called the Moore HMM. An equivalent definition, more common in the computer science 
literature is that of a Mealy HMM, which can be formulated as the process generated by 
a stochastic finite-state generator, and will be the one considered in the present work. 
Stochastic finite-state generators differ from finite-state machines used for recognition 
of regular languages in two ways. They have probabilistic transitions, similar to Paz's 
probabilistic automata [TJ. And they generate sequences instead of recognising them. In 
the following, we use the minimal number of internal states that a device needs in order 
to generate a stochastic language as a measure of complexity [HIE]. This quantification 
of complexity is complimentary to the notion of algorithmic complexity [TOj [TT] . 

2.1. Stochastic finite-state generators and hidden Markov models 

Let us recall the definition of a stochastic finite-state generator from Ref. [I]. A stochastic 
finite-state generator is a tuple (S, A, T) where S is a finite set of states, A = {s} 
is a countable set of symbols, output alphabet, and T = {T s : s £ A} are square 
substochastic matrices of dimension IS"), such that ^2 S T S is stochastic. The system 
undergoes transitions between internal states and every transition has an associated 
output symbol. The generator is fully characterized when all conditional probabilities 
Pr(s; j\jo) are given, that is, the probability of yielding symbol s £ A and going to state 
j conditional on the machine being in state jo- These probabilities are summarized by 
the set of substochastic matrices T s , where [T s ] 3 - 3 - = Pr(s; j|j ) I The sum X/se-A^s ^ s 
a stochastic matrix which describes the Markovian evolution of the state space when 
the output symbols are disregarded. These automata can be represented by a directed 
graph where nodes correspond to states and directed edges correspond to transitions 
with non-zero probability (see Ref. jl] for details and Fig. [1] for an example of such a 
representation). 

The computation of word probabilities is easily done in terms of the matrices T s . 
The conditional probability of word s = (si, . . . , s n ) given an initial state jo is 

Pr(s|j )= Pr ( 

\jn-i) ■ ■ ■ Pr(s 2 ; j 2 |ji)Pr(si; ji|j ) (1) 

jl,j2,—jn 

which can be written as 

Pr(sbo) = E[ T sk,o > (2) 

jn 

where we have defined Ts = T Sn ■ ■ -T S2 T Sl . Finally, the state of the machine can be a 
statistical mixture of all possible internal states, which is conveniently described by a 

| In [4] the authors used row vectors and right multiplication. Here we use column vectors and left 
multiplication in accordance with standard notation in quantum information. 
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Figure 1. A deterministic generator of the Even-Process: Blocks of an even number 
of Is are separated by Os. Only the asymptotically recurrent states are shown. Edges 
are labeled p | s, where s £ A and Pr(s; i\j) = [T s ]ij. 



vector 1 7r). This can be used as a prior distribution when the initial state is uncertain. 
The stable stochastic process is obtained from the steady state of the machine, defined 
as the eigenvector \ir*) with eigenvalue 1 of T = ^2 a T s , namely 

k*) = y> s K) . (3) 



seA 



Finally, word probabilities can be computed by defining the vector |1) = (1, 1, . . . , 1) T , 

Pr(s) = (i|T s „---r S2 r sl |7r*) . (4) 

Given a stochastic finite-state generator and a prior probability distribution \n ) of 
the machine state, all word probabilities are established and a HMM is uniquely defined. 



2.2. Example of a stochastic finite-state generator 

As an example we give the stochastic finite-state generator for the Even-Process whose 
language consists of blocks of even numbers of l's bounded by O's. The substochastic 
transition matrices are 

T -(!!l)- dT '-(!o)- (5) 

Again, notice that left-multiplication is used. The corresponding graph is shown in 
Fig. [TJ The set of irreducible forbidden words is countably infinite [T2] : T = {01 2Z+1 : 
I — 0, 1, 2, . . .}. As a consequence the words in the Even-Process have a kind of infinite 
correlation: the "evenness" of the length of 1-blocks is respected over arbitrarily long 
words. This makes the Even-Process effectively non- finite: As long as a sequence of l's 
is produced, memory of the sequence persists [15] . 



3. Quantum Processes 



We now turn to quantum systems and the process languages they generate. As with 
stochastic processes, we assume that the evolution of a quantum system is recorded as a 
sequence of measurement outcomes. Just like before, the distribution over sequences of 
these random variables is a process. A computation-theoretic representation of a process 
generated by a quantum systems is the quantum finite-state machine introduced by one 
of the authors [4]. These machines, reviewed below, are based on a von Neumann 
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measurement. In order to distinguish them from the more general Hidden Quantum 
Models introduced later on, we will call them in the following von Neumann finite-state 
generators. 

3.1. Quantum von Neumann finite- state generators 

Like stochastic generators, a quantum von Neumann finite-state generator, as introduced 
in [3], outputs a symbol s G A and updates its internal state ip. Now ip belongs to an 
IS 1 1 -dimensional Hilbert space H instead of belonging to a set S, and is consistently 
denoted throughout the quantum information literature by The classical states 
j G S correspond to an orthonormal basis in H, {\ipj)}. Properly normalized linear 
combinations of are also allowed as state vectors. Symbols are obtained by 
measuring the quantum system. For the von Neumann generators only von Neumann 
measurements are considered, which are described by a complete set P of projection 
operators, 

P = {P s : 8 G A and ^ P s = 1} . (6) 

s 

Between measurements, a unitary transformation U is applied to the system. The overall 
effect can be described by the operators T s = P S U. Starting with the state \if) t ) at time 
t symbol s is put out and |^> t+1 (s)) = P s U\ip t ) is the (unnormalised) state at the next 
time step. In general, \ip(s)) denotes the resulting state after starting with \ip) and 
obtaining measurement outcomes s. The unnormalized state \ip(s)) can be expressed as 

|#0>=W>, (7) 
where again T§ = T Sn ■ ■ -T S2 T S1 . The probability of obtaining the word s from state 
is given by 

Pr(s) = |||^(s))|| 2 = (^|T s t T s |^) . (8) 

3.2. Density matrix representation 

The above formulation of a von Neumann finite-state generator is developed in analogy 
to a stochastic finite-state generator. A more convenient way, and at the same time more 
general, is a formulation in terms of density matrices [U E] ■ This allows to describe 
the most general state of the system, accounting for classical uncertainties as well as 
quantum indeterminacy. A state is then described by density matrix p = \tp){ip\. 
The action of T s on is replaced by 

%p = T s \^)^\Tl. (9) 

Here 7s is a linear transformation on p, usually called a superoperator. The probability 
of obtaining word s then reads 

Pr(s) = tr[T s p] . (10) 

The density operator formalism will allow for a powerful generalization of the von 
Neumann finite-state generator. 
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Figure 2. von Neumann finite-state generator for the Quantum Even-Process. 



3.3. Example of a von Neumann finite- state generator 

An example of a von Neumann finite-state generator is shown in Fig. [2J It generates 
the Even-Process language we are already familiar with. It consists of blocks of even 
numbers of l's bounded by O's. It's transition matrices T s can be constructed from the 
following projection operators P s and the unitary matrix U [I], 

° ° \ / 75 - 75 \ 

1 > U = 75 75 
1/ \ -1 / 

The corresponding directed graph is shown in Fig. |2j This generator consists of 3 internal 
quantum states. This is the smallest dimension needed to generate the Even Process 
with this kind of generators. 
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3.4- More general quantum processes 

Notice that the von Neumann finite-state generator above has three states which is 
more than the stochastic generator in Section 12.21 required. This means, the quantum 
representation is less compressed than the classical one. This is rather counterintuitive. 
As we shall see below, the reason for this is the restriction to unitary transformations 
U and projective measurements P s . No room is left for interaction with auxiliary 
quantum systems, or the resetting of parts of the system. However, physical systems 
with such couplings - and many quantum technology experiments relying on them - 
can be relatively simple. Hence realistic measurements are often imperfect and noisy, 
where the von Neumann measurements are an idealization. We will see that extending 
the formalism to density operators will allow for, not only describing more realistic 
processes, but also encompass the whole class of classical generators. 
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4. Hidden Quantum Models 

In this section we define the Hidden Quantum Markov Model (HQMM), based on the 
notion of quantum operation. The spirit underlying our definition follows exactly the 
same lines as the definition of a HMM. In a HMM (HQMM) there is an underlying 
Markovian (Quantum) process which rules the probability of the symbols generated. 
We will see how word probabilities and the steady state for HQMMs are obtained in 
full analogy to HMMs. 

4-1. Quantum operations 

This section is a review of the theory of the so-called quantum operations, introduced 
in the seminal papers |6j [151 IB] and for which several reviews are available (see, for 
example (I4"1H7] ). 

A quantum operation /C is a completely positive (CP) trace non- increasing linear 
map on the space of density operators (CP map in short). A theorem due to 
Stinespring [H] shows that every CP map admits a representation of the form 



where iQ are linear operators acting on Hilbert space H, often called Kraus 
operators [17] . Eq. (refeq:operator-sum-representation) is called the operator-sum 
representation of /C. Conversely, every map of the form ( TT2|) is completely positive. 
It is worth stressing that the operator-sum representation is in general not unique, thus 
the physical significance of the Kraus operators is not always straightforward. The trace 
non-increasing condition naturally reads 



Quantum operations can be classified according to different criteria. They can be 
trace preserving ^ K\Ki = I or trace-decreasing £\ K\Ki < I. In the former case, they 
map density operators to density operators, and are often regarded as quantum channels, 
or more technically, CPTP maps. If they are trace-decreasing they usually are a piece 
of a larger object, i.e., a complete set of trace-decreasing operations {/C s }, forming a 
stochastic quantum operation. This corresponds to the most general transformation that 
a quantum state can undergo, which generates a symbol or measurement outcome, in 
addition to the final state of the system. A stochastic quantum operation has to fulfill the 
condition that K = J2 S fC s is trace-preserving (a quantum channel), for the final state of 
the system has to be a properly normalized density operator when the generated symbol 
is discarded. The notion of stochastic quantum operation encompasses anyhting from 
unitary transformations (]C S • = U ■ W) to von Neumann measurements ()C S ■ = P s ■ P s ), 
as well as generalized measurements such as POVMsJjjl 




(12) 




(13) 



§ A remark about POVMs is in order. A POVM is a powerful tool to compute the outcome probabilities 
of any possible quantum mechanical measurement, but it does not provide information about the 
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Other possible classifications are, whether they are pure operations or not. A pure 
operation maps pure states onto pure states, which means that there exists an operator- 
sum representation which consists of only one Kraus operator. The action of a pure 
operation can be tracked by a pure state whereas in general, superoperators can only 
be understood as acting on density operators. Further classification may distinguish 
between unitary and non-unitary operations. In particular, a unitary operation is trace- 
preserving and pure. Apart from the transformations enumerated so far, quantum 
operations can easily describe the physical process of coupling the system to an ancilla 
and measuring the ancilla, performing a transformation on the quantum system itself. 
The latter is dependent on a previous outcome and possibly some random variable 
obtained by completely external means. Some examples of these different operations 
will appear throughout the remainder of the paper. 

Let us go back to (trace-decreasing) stochastic quantum operations. These 
correspond to operations that cannot be implemented with unit probability. They often 
represent the action of a quantum measurement on a system, for a specific outcome s. 
The probability of successfully implementing a given operation JC S on quantum state p 
is given by 

Pr(s) = tr[/C s p] . (14) 

We can assign a set of quantum operations {IC S } to a set of outcomes A = {s}, such 
that each outcome occurs with probability Pr(s) and the conditional state after outcome 
s is 

Ps = P^)- (15) 

Let Ki(s) be the Kraus operators of an operator-sum representation of K, s . Unit 
probability J2 S Pr(s) = 1 is guaranteed by the fact that J2 S K, s is trace-preserving, 
i.e., 

J2Kj(s)K t (s) = I. (16) 

s,i 

which shows that the complete set of Kraus operators (running indices i and s) form 
a quantum channel. This channel corresponds to performing the measurement (or 
stochastic channel {JC S }) and forgetting the outcome, since the resulting state is 

p = j2^)ps = y, k ^)p k K s ) ■ ( 17 ) 

s s,i 

Finally, every trace-preserving operation has a steady state, defined as the eigenvector 
(understood in terms of superoperators as linear transformations and density operators 
as vectors) with eigenvalue 1, p* — JCp*. Analogously, the steady state of a stochastic 
quantum operation is p* = J2 S ^sP*- 

resulting state after the measurement. Quantum operations do provide this information, while the 
POVM element can always be recovered from the operator-sum representation. 
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EMM 


HQMM 


State 


k> 


P 


Transitions 


Substochastic {T s } 


Trace-decreasing {JC S } 


Forgetful transition 


Stochastic T = J2 S T s 


Trace-preserving K = J2 S 


Steady state 


|tt*) = T\n*) 


p* = JCp* 


Pr(s) = 


(l\T Sn ---T S2 T sl \7r*) 


(I|/C Sn ---/C S2 /C s >*) 



Table 1. Analogy between the classical finite-state generator and the stochastic 
quantum operation. The mapping is straightforward by replacing probability vectors 
by density operators, transition matrices with CP-maps, of which stochastic matrices 
correspond to trace-preserving maps and substochastic corresponds to trace-decreasing. 
Finally, taking the inner product between the final state T Sn ■ ■ ■ T S2 T Sl and (1|, 
respectively is equivalent to taking the Hilbert-Schmidt inner product between vectors 
K Sn ■ ■ ■ K- S2 IC Sl \p) and the identity (I|. 

4-2. Definition of the Hidden Quantum Model 

Notice in Table Q] the analogy between the structure of stochastic generators and the 
notion of stochastic quantum operation |17j . Every piece in the classical formalism has 
a direct counterpart in the quantum formalism. It is thus natural to define a quantum 
stochastic generator following this analogy 

Definition: A Hidden Quantum Markov Model (HQMM) is a <i-level quantum system 
p together with a set of quantum operations fC s such that J2 S fC s is trace-preserving. At 
every time step a symbol is generated with probability Pr(s) = tr[/C s p] and the state 
vector is updated to p s = /C s p/Pr(s). 

The definition of quantum generators based on operations is useful in several ways, 

• The /C s quantum operations play, in quantum mechanics, the role of the 
substochastic matrices T s for the SGs. They provide a description of the whole 
process (state transitions as well as probabilities). As we will see in Sec. I4.3[ 
defining HQMMs in terms of quantum operations easily accommodates SGs in a 
straightforward way. This is a highly desired and natural feature in the sense that 
quantum devices are often expected to generalize classical devices. 

• Orthodox projective measurements are ideal and often the hardest to realize. 
Instead, realistic measurements are often performed by coupling the quantum 
system of interest to some auxiliary system, or ancilla, which is later measured. 
The whole process can then be regarded as a generalized measurement, described 
by a POVM. The extension of quantum generators to HQMMs is well-suited to 
accommodate models for such processes, arising naturally in the study of quantum 
systems, and hence providing a natural framework for modeling the generated 
stochastic processes. 

• We will show an example case where a stochastic process needs 3 states to be 
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generated classically, whereas only 2 states suffice when it is generated quantum- 
mechanically. This improvement suggests that an increase in efficiency may be 
possible, by harvesting the power of quantum mechanics in the task of process 
generators. Also, HQMMs may provide a more efficient means to model complex 
stochastic processes. Whether this improvement is significant or not for highly 
complex processes is left as an open question. 

4-3. Properties 

We now derive some properties of the HQMM and provide prescriptions for generating 
them from classical processes. 

Theorem: For every SG with d internal states there exists a HQMM with the same 
number of internal states which generates the same stochastic process. 
Proof: We prove the theorem by construction. We first provide a prescription for 
constructing the HQMM and then show that the word probabilities are consistent with 
the T matrices. 

Let the internal states of the system be represented by {pi = The transition 

from state pj to state pi together with outcome s has to occur with probability 
Pr(s; i\j) = [T s ]ij. For every symbol s we define a quantum operation /C s with operator 
sum representation 

£sp = J2 K i' 3 P K t l ' J > Ri s 3 = v&i^oi • ( 18 ) 

ij 

Thus we achieve 

^sPi = ^2[T s }ijpi , (19) 

i 

and the probabilities are, 

Pr(s\j) = tr[/C sPj ] = J2[Tsh = £ Pr(s; . (20) 

i i 

Namely, the probability of outcome s given initial state j, X^P~s]«j i s consistent with 
our formulation. In addition, the final state undergoes the standard stochastic evolution 
according to the transition matrix [T s ]ij ■ 

Notice that this definition encompasses all possible SGs within the quantum for- 
malism. However, it is worth mentioning that with this embedding, the system does 
not exhibit quantum coherence since the density operator is always diagonal in the ba- 
sis as is readily seen by checking (i\JC s p\j) oc for any p. We now look at a 
class of SGs that always admit a coherent representation in terms of pure states and 
operations. These will provide the grounds for exploring dynamics not available in the 
classical formalism. 
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Definition [[4J]: A deterministic generator is one such that for each outcome s and 
each internal state j, the state can only transit to another state i. This means that for 
each column j in each matrix T s there is only one nonzero entry. Let Pr(s|j) be the only 
nonzero value in the j'th column of T s , and Ij{s) be the row in which Pr(s|j) appears. 
The function / will be useful in the following. 

The idea behind deterministic generators is that given the initial state and the se- 
quence of outcomes, the state of the system can always be tracked. 

Definition: A reversible generator is a deterministic SG for which each T s has no more 
than one nonzero entry per row. Using the Ij(s) notation, this reads 

Ifa) = fy(a) *=*j=f, (21) 
or equivalently, 6 Ij ( s )i.,( s ) = Sjj>. 

Reversible generators have the property that the state of the system can be tracked 
back if the final state and the sequence of outcomes are known. 

Theorem: For reversible generators it is possible to define a HQMM in terms of pure 
operations. 

Proof: Let JC S be the quantum operation associated to symbol s, with operator sum 
representation 

K sP = K sP Kl K S = J2V^W)\IM)(J\- (22) 

j 

The unnormalized quantum state after outcome s is 

K.\j) = y^mil.is)), (23) 

and outcome s occurs with probability |fG|j)| 2 = Pr(s|j). Finally, the trace-preserving 
condition is satisfied 

= EE^'V / Pr( S |j)Pr( S |j')|j)(j , | = ££Pr(sU)b')0'l =1,(24) 
s s jj' j s 

where the first equality follows by virtue of Eq. ( |2T1) . ■ 

The set of SG that admit a HQMM representation in terms of pure states and 
operations is not restricted to reversible generators, but all reversible generators admit 
such representation. 

In analogy to Eq. (j3J), the stationary state p* is defined as 

p* = ^/C s p*. (25) 

s 

and word probabilities are computed as 

Pr(ai...s n ) =tr[/C s „---/C Sl p*]. (26) 

Finally, it is worth noticing that defining the Hilbert-Schmidt product {A\B) = tr[A*B], 
Pr(si . . . s n ) can be written as 

Pr(si...s n ) = (I|/C Sn ---/C Sl |p*), (27) 
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in full analogy with Eq. PJ. 

5. Non-adaptive read-out of many-body states 

We now point out the relation between a Hidden Quantum Model and the sequential 
readout of a many-body state. As an example we start with the sequential readout 
of a ID cluster state. As we shall see below, these read-outs are examples of 
HQMMs which generate stochastic languages with potentially long-range correlations. 
Although this particular example (ID cluster states) does not provide universal resources 
for quantum computation, the generalization to 2D cluster states, or, equivalently 
multiqubit HQMMs does, in principle, capture the power of quantum computation. 

5.1. Preparation and non-adaptive read of ID cluster states 

Let us start with a short review of ID cluster states [18]. One way to generate a ID 
cluster state of N qubits is to first prepare N qubits in the same state |+), 

|+)^(|0) + |l))/v / 2, (28) 

which is an equal superposition of |0) and |1). Afterwards, N — 1 controlled two-qubit 
phase gates U nn -i, 

C/ nn _! = |00) nn _i<00| + |01) nn _i(01| + |10) nn _i(10| - |ll) nn _ 1 (ll| 

= |0) ft <0|®I n _i + |l) n <l|(8)^ n _i, (29) 

should be applied to all neighboring qubits. An iV-qubit ID cluster state can hence be 
written as 

(cluster^) = U NN . 1 --- U 32 U 21 \+)® N . (30) 

Once a large cluster state is prepared, the easiest way to generate a sequence of 0's 
and l's is to perform successive single-qubit measurements. Suppose, a is obtained, if 
the qubit is found in |e ) and output 1 is obtained, if the qubit is found in |ei) with 

|e ) ee cos <f> |0) + e 1 ^ sin <fi |1) , 

|ei) ee sin0|O) - e i? cos</>|1) (31) 

with and £ being free parameters. The corresponding projection operators are 
P s . = |e Si )(e Si |. For example, n measurements on a cluster state consisting of N > n 
qubits project them into the (unnormalised) state P Sn ■ ■ ■ P Sl | cluster at), where Sj is the 
outcome of the i'th measurement, and it is implicitly understood that P Si acts on the 
i'th qubit. The probability to obtain the word s of length n hence equals 

Pr(s) = \\P Sn ---P Sl (clustery) f. (32) 

As we shall see below, the obtained bit sequences are completely random for certain 
parameters </> and £ and contain long-range correlations for others. 
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Figure 3. Sequential generation and non-adaptive read-out of a one-dimensional 
cluster-state. Initially, all atoms are prepared in |+). Afterwards, entangling phase 
gates U n +i n are applied successively just before a measurement is performed on the 
state \<p n ) of qubit n. 



5.2. Non-adaptive cluster-state read-out in operator-sum representation 

Before analysing the above process in more detail, let us show that the non-adaptive 
read-out of a cluster state is a concrete example of a HQMM with one qubit. The reason 
for this is that the entangling operations U nn ~i for the preparation of the cluster state 
commute with the projections P Si whenever % is different from n and n — 1. It is therefore 
not necessary to complete the build up of a cluster state of size N before measuring its 
qubits. Instead, one can constantly add new qubits to the chain, as illustrated in Fig. [3j 
as long as U nn ^i and U n+ \ n are performed before the read-out of qubit n takes place. 

To describe the cluster state read-out of qubit n, it is hence sufficient to consider a 
chain of no more than n qubits. After measuring the first n — 2 qubits, the unnormalised 
state of this chain equals 

|+)|^(s"- 2 )) n _ 1 |e Sn _ 2 ) . . . |e Sl > = P Sn „ 2 f4_ ln _ 2 • • • P S1 U 21 \+)® N (33) 

Here |v?(s n_2 )) n _ 1 denotes the state of qubit n — 1 prior to its measurement and after 
measuring qubits 1 to n — 2 and obtaining the word s n ~ 2 = (si, . . . , s n _2)- The state 
needs to be normalised by Pr(s™ -1 ), obtained from Eq. [321 Analogously, one can show 
that the (again unnormalised) state of the n qubits after the detection of qubit n — 1 is 
in this scenario given by 

|^(s"- 1 ))„|e Sn „ 1 ) ...10 = P^nn-i • • • P S1 U 21 . (34) 

with |<£>(s n-1 )) n describing qubit n prior to its measurement. A comparison of these two 
equations then leads us to the relation 

\ V {s n - l )) n \e Sn _ 1 ) = P s „_ 1 f/„„-i|+)|^(s"- 2 )) n _ 1 . (35) 

Using Eqs. (1291) and applying I <g> (e Sjl _J from the left, this equation leads us to 

|^(s^ 1 )) n = K Sn _ x Ks"- 2 )}^ (36) 

with 

K Si = ^=(\0)(e Si \ + \l)(e Si \Z) and Z = |0)(0| - |1)(1| (37) 

which relates the state of qubit n prior to its measurement to the state of qubit 
n — 1 prior to its measurement. Analyzing the probabilities we see from Eq. (IMj) that 
Pr(s n_1 ) = || |y9(s n_1 )) || 2 , while Eq. f|36|) can be written as 

2 

Pr(s n - 2 ), (38) 



Prfs 



n-li 



K 



Sn-l 



Pr(s 



n-2\ 
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showing that Pr(s n _i|s™ 2 ) can be computed from the normalized state vector 
|^(s n - 2 ))/ v /Pr(s™- 2 ). 

From Eq. ( 1361) we see that the non-adaptive read-out of a ID cluster state is 
equivalent to performing the same pure quantum operation over and over again on 
a single qubit. After n — 1 measurements generating the word s n ~ 1 the state of this 
qubit equals (up to normalisation) 

Ms n - 1 )} = K Sn _ 1 ...K Sl \+). (39) 

Here, we dropped the subscript n in |y9(s n_1 )) n since we only describe a single qubit, 
but after n — 1 time steps. In other words, the non-adaptive read-out of a cluster state 
is a concrete realisation of a HQMM where the hidden quantum system consists of just 
one qubit. The operators K and K\ indeed obey condition (fT6l) for an operator-sum 
representation. The state |+) in Eq. ( 134"1) can be regarded as an ancilla which assists 
the detection of the qubit. After each measurement, the ancilla assumes the role of the 
qubit and the former qubit is replaced by a fresh ancilla prepared in |+). This process 
is equivalent to resetting part of the system. 

Finally, let us comment on the information contained in the state \(p(s n ^ 1 )) about 
previous measurement outcomes. Suppose \ip(s n ~ 2 )) = a\0) + f3\l). Using Eqs. ( 13~TT) . 
()36|) . and (|37|) and calculate ^(s™ -1 )) as a function of the complex coefficients a and f3, 
we then find that 

K |^(s n ~ 2 )) = a cos0 |+) + /Se - * sin0 |-) , 

K x |^(s n " 2 )) = a sin0|+) -/3e- if cos0|-) (40) 

with |-) = (|0) - |l))A/2. Both states depend on a and /3, even after normalisation. 
This is different to von Neumann measurements which erase the coefficients a and 
when the respective projector is applied. In a HQMM, quantum information about the 
history of the system can in principle survive for many time steps. 



5.3. Analysis of the language generated by non-adaptive cluster state read-out 

As suggested in Section H~3l we now calculate the stationary state p* of the non-adaptive 
cluster state read-out. Using Eq. ( 1251) and the Kraus operators in Eq. ( )37l) we find that 
the stationary state of the system is a completely mixed state, 

P*=~I, (41) 

independent of the parameters <fi and £ in Eq. ( 13~T|) . This state can now be used to 
predict word probabilities. Using Eq. (134"1) . we can easily show that the symbols and 
1 occur with the same frequency, i.e. Pr(0) = Pr(l) = |. Using Eqs. fl26|) and f )27|) . we 
moreover find that all length-2 words occur equally often, i.e. 

Pr(00) = Pr(01) = Pr(10) = Pr(ll) = - . (42) 

This shows that the language created during the non-adaptive cluster state read out 
contains no length-2 correlations in the long run. However, looking at length-3 word 
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1.0 



Figure 4. Entropy of three-letter words (H in bits) as a function of the measurement 
parameters £ and <fi. The entropy attains the maximum 3 for <f> = kit/ 4. 



probabilities, we find 
Pr(OOO) 



Pr(lll) 



32 
1 



8 32 



cos £ (sin 20 + sin 60) , 
cos £ (sin 20 + sin 60) 



(43) 



and 



Pr(Oll) = Pr(101) = Pr(llO) = Pr(OOO) , 

Pr(OOl) = Pr(010) = Pr(100) = Pr(lll) . (44) 

Depending on £ and 0, words with an even number of l's can occur more often (or less 
often) than words with an odd number of l's. 

Looking at length-3 words we find that they provide an entropy 



H 3 = 5 - - log (16 - cos 2 £(sin 20 + sin 60) 2 ) 



2 _ ^_ T r . ^ 4 + cos ^ sin2 + s i n 60) - ' (Jo) 
which is smaller than 3 for values of £ 7^ and 7^ showing that there is length-3 



+ - cos £ cos 20 sin 20 log 
correlation [see Fig. H] 



8 



5-4- Sequential readout of matrix-product states 

In this section we show that the statistics of sequential measurements on some matrix- 
product-states (MPS) (see [19] and references therein) can be simulated by HQMM. 
More specifically, we concentrate on translationally-invariant open boundary condition 
MPS with bond dimension D, of a many-body state 



G U% n of the form 



E ^••■V-| W ..,z 1 >, 



(46) 



ll,...,ln 
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where runs from 1 to d — dim'Hg and Vr^, 1 < k < n are D x D matrices and the 
first and last are row and column vectors, respectively. In [201 EH] it is shown that every 
MPS of the form of Eq. [46]) can be generated sequentially by isometries — > 'Kj^®'Kb 
of dimension dD x D, with the constraint that the last isometry decouples the spin chain 
from the system Ha- The isometries are of the form 



and the assuming that = (V'iH'^M • • • Vji]!^/)- Here greek indices refer to dimensions 
on system A and latin indices refer to system B, and and \iPf) are initial and 
final states of system A, respectively. Since we are interested in generating stochastic 
processes with arbitrarily long sequences, we will only be concerned with the initial 
state. The final state will not enter our discussion. Moreover, translational invariance 
of the MPS representation means that all matrices Vnu are independent of the site index, 
k. We therefore we drop it from now on[Jjl 

A more physically intuitive picture arises by considering the isometries as entangling 
unitary transformations V between system A and system B in an initialized state 
|0) G H-Bi such that when acting on an initialized ancilla yields 



A note about semantics is in order. In the original paper [20] the term ancilla 
refers to system A whereas in our language we consider system B to be the ancilla. 
This is because in the literature, concern is focused in generating multipartite quantum 
states, and system A only assists in this process. Instead, in our approach, system B 
is considered only as an assistance for implementing generalized measurements on A, 
hence we call B the ancilla. 

Now, after kth ancilla B has been involved in the corresponding isometry, it can be 
measured, just like in the example of Sec. 15.21 Let p be the state of the system prior to 
step k. Attaching the initialized ancilla and performing the entangling operation yields 
V (pk-i <8> |0)(0|) Now, performing a projective measurement on system B yields 




(47) 



i,a,/3 





p s = tig [(I <g> P S )V (p ® |0> (0|) V f (I ® P s )\ 

By defining the quantum operation K s - = ^\ K\ ■ K l J with 



(49) 




(50) 



we can write 



Ps 



(51) 



while 




(52) 



|| Notice that translational invariance of a quantum state does not necessarily mean that it has a 
representation with the same invariance. 
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showing that {IC S } a well defined stochastic quantum operation. 

This shows that, although arbitrary MPS states will require specific initial and 
final isometries (initialization of system and decoupling in the last step, \iPf)), we 
are only interested in long sequences of outcomes for arbitrarily large MPS, and hence 
we can disregard the final decoupling step. Therefore HQMMs can generate the same 
measurement statistics as sequential identical measurements on any many-body state 
that admits a translationally invariant MPS representation 

|V>} = ^2{MV in ---V il \^i)\in---ii)- (53) 

i\...i n 

The number of internal states of the required HQMMcorresponds to the bond dimension 
D of such MPS representation. The study of random processes generated by HQMMs 
should then be highly connected to the results on correlation lengths and other properties 
of certain many-body systems. To the best of our knowledge, this establishes a -yet 
unexplored- two-way communication between the theory of many-body states and the 
theory of stochastic processes. 



6. An example where quantum outperforms classical 



After showing that HQMMs provide a convenient framework to model stochastic 
processes generated by a variety of quantum systems, it is reasonable to ask whether 
a more efficient description of a given stochastic process is allowed in the quantum 
formalism as compared to the classical case. A general answer to this question is beyond 
the scope of this paper. However, we will provide evidence that some stochastic processes 
admit a simpler representation within the quantum formalism. For this we present a 
4-state classical model, and show that it cannot be reduced to fewer than three states. 
Then we provide a 2-state HQMM that generates the same process. 

Consider the 4-symbol stochastic process (s G {0, 1,2,3}) given by (states labeled 
in the order U,D,R, L) 



( 1/2 






To 



V 



V 






1/4 











1/4 




1/4 








1/2 




1/4 \ 




o\ 






/o 




v° 

/ o 




\ 1/4 




1/2 









1/4 




1/4 











1/4 









1/2 J 



(54) 



and is depicted in Fig. 

A simple method for obtaining a lower bound to the number of internal states 
necessary for representing a given HMM was provided in [21]. This bound may turn 
out to be too loose, since positivity and other conditions are not enforced. However, it 
will suffice to make our point. In our argument we follow closely the approach in [21 J . 
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Figure 5. Diagrammatic representation of the stochastic generator for the 
HQMM defined by flU]). 



Suppose the statistics of the model (I54j) can be obtained from a HMM with n internal 
states. Then, consider the matrix 



H 



( Pr(0) 


Pr(0) 


Pr(l) 


Pr(2) 


Pr(3) \ 


Pr(0) 


Pr(00) 


Pr(10) 


Pr(20) 


Pr(30) 


Pr(l) 


Pr(01) 


Pr(ll) 


Pr(21) 


Pr(31) 


Pr(2) 


Pr(02) 


Pr(12) 


Pr(22) 


Pr(32) 


V p r(3) 


Pr(03) 


Pr(13) 


Pr(23) 


Pr(33) j 



(55) 



This is the upper-left corner of an infinite matrix known in the literature as the Hankel 
matrix. By convention it is assumed that Pr(0) = 1. Expanding the structure of 
Pr(siS2) = (l|^s 2 ^siK) we can write 



H 



/(I 

(1 
(1 
(1 

v a 



\To 
\Ti 

\TsJ 



( T®\n) T \n) Ti\n) T 2 \n) T 3 |7r) 



(56) 



where T = I. Notice that each block in this factorization is a vector of dimension n. 
Therefore the rank of both the left and the right matrices in Eq. f[5"6"j) are bounded by 
n. Since H and all similar subblocks are factorized in the same manner, any sublock of 
the Hankel matrix, and in particular that shown in Eq. ( 15 5 p . cannot have rank higher 
than n. Assuming that n could be reduced to 2, we are thus led to the conclusion that 
rank(_ff) < 2. It is now straightforward to explicitly compute rank(if). For this, use 
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Eq. (JMD together with ^ s T s |tt) = |tt), with |tt) 



( 1 



rank(i7) = rank 
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J_ 

16 
J_ 

16 
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16 
J_ 

16 



1 

1 

J_ 

16 
J_ 

16 
1 

8 





1 

4 

J_ 

16 
J_ 

16 



1 

8 



|| 1). Then 



(57) 



/ 



This shows that the model described in Eq. (j5%j) cannot be implemented by a two-state 
HMM. It is, however, generated by a HQMMdescribed by (JC y - = K y ■ KU: 



K n 



T2 1 txt 

71 1 Wtt 



-X+l 



1 



(5? 



Indeed, the HMM in Eq. fl54J) can easily be derived from the HQMM in Eq. (J5EJ) • 



7. Discussion 



We have introduced Hidden Quantum Models, inspired by the success of Hidden 
Markov Models in modelling a wide variety of relevant stochastic processes, and 
by the natural analogy that exists between the latter and the modern formalism 
of Quantum Mechanics. We expect HQMMs to provide a wide framework which 
allows to systematically study quantum processes in which the access to the quantum 
system is limited, and measurements are constrained to some constant and sequential 
leaking of classical information. We have considered the least restrictive approach and 
considered most general CP maps which describe not only the outcome statistics of 
the measurements but also the effect on the quantum system. These models are a 
generalization to previously considered classical automata, such as stochastic generators, 
Mealy automata and hidden Markov models. At the same time, our models generalize 
the class of quantum generators considered previously in the literature. The advantages 
of considering HQMMs are many-fold. On the one hand, it is sufficiently general to 
naturally encompass all Hidden Markov Models, a highly desirable feature for any 
quantum model attempting to outperform their classical counterpart. On the other 
hand, they provide the most compressed description of a quantum process by only 
accounting for the dynamics of the relevant part of the system, i.e., that which contains 
the quantum information latent in the system. 

We foresee a number of questions related to HQMMs with practical and theoretical 
relevance. We have shown that HQMMs can provide a reduction of the necessary number 
of internal states necessary for generating some stochastic processes, as compared with 
classical generators. It is then natural to ask to what extent does this reduction take 
place, i.e., whether a significant reduction of the resources can take place, or classical 
generators only require a polynomial overhead on the resources required by HQMMs. 
On a related ground, HQMMs are fit to describe processes which are simple enough to 
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be considered repetitive, but have an unavoidable quantum essence. It is interesting 
to ask whether the dimensionality of the quantum system induces some limitations 
on the generated stochastic processes. This would certainly have implications such as 
fundamental dimensionality tests for quantum systems under limited accessing freedom. 
Moreover, in sight of the relation between HQMMs and MPS, unraveling the capabilities 
and limitations of HQMMs may yield insight on the role of adaptivity in measurement- 
based quantum computation. 

On a more applied level, it is worth noticing that a well established theory of in- 
ference exists for HMMs J22J [23] . This can be roughly divided in two classes, namely, 
state inference and parameter inference. Both of these have close cousins in the field 
of quantum metrology [23J [25]. It is natural to ask to what extent can these tools be 
adapted for addressing questions regarding HQMMs, such as those collected in [23]. It 
is worth mentioning that some of these questions have already triggered interest within 
the quantum information community [26J. 
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